Skip to content

Conversation

@dstandish
Copy link
Contributor

@dstandish dstandish commented Apr 10, 2025

Each dag run is associated with a set of serdags via the bundle version / dag_id combination. When making scheduling decisions we need to use one of these serdags. Using the latest one is the best we can do right now.

Simpler alternative to #48956

Closes: #49007

@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Apr 10, 2025
@dstandish dstandish force-pushed the dag-run-scheduling-should-use-correct-serdag branch from b0cf728 to 5cb6289 Compare April 13, 2025 12:24
@dstandish dstandish force-pushed the dag-run-scheduling-should-use-correct-serdag branch from b60797f to 5c40ade Compare April 14, 2025 04:13
@dstandish dstandish marked this pull request as ready for review April 14, 2025 04:13
@dstandish dstandish requested review from XD-DENG and ashb as code owners April 14, 2025 04:13
@dstandish dstandish force-pushed the dag-run-scheduling-should-use-correct-serdag branch from be6a292 to 61d8be1 Compare April 14, 2025 14:43
@dstandish dstandish added the full tests needed We need to run full set of tests for this PR to merge label Apr 14, 2025
@dstandish dstandish force-pushed the dag-run-scheduling-should-use-correct-serdag branch 3 times, most recently from e494aab to 98ccdb7 Compare April 14, 2025 18:49
Each dag run is associated with a set of serdags via the bundle version / dag_id combination.  When making scheduling decisions we need to use one of these serdags.  Using the latest one is the best we can do right now.
@kaxil kaxil merged commit ad26044 into apache:main Apr 15, 2025
93 of 95 checks passed
@kaxil kaxil deleted the dag-run-scheduling-should-use-correct-serdag branch April 15, 2025 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Versioned dag run uses the latest version of serialized dag in the Scheduler instead of sticking to their version

4 participants